Afferent specificity, feature specific connectivity 
influence orientation selectivity: A computational 
study in mouse primary visual cortex 



Dipanjan Roy , Yenni Tjandra , Konstantin Mergenthaler , Jeremy 
Petravicz**, Caroline A. Runyan**, Nathan R. Wilson**, Mriganka Sur** and 

Klaus Obermayer* 

-J; 

Department of Theoretical Computer Science, Technische Universitat 

Berlin 

**Picower Institute for Learning and Memory, Department of Brain and 
Cognitive Sciences, Massachusetts Insitute of Technology, Cambridge, MA. 

January 8, 2013 
Abstract 

Primary visual cortex (VI) provides crucial insights into the selectivity and emer- 
gence of specific output features such as orientation tuning. Tuning and selectivity of 
cortical neurons in mouse visual cortex is not equivocally resolved so far. While many 
in-vivo experimental studies found inhibitory neurons of all subtypes to be broadly 
tuned for orientation other studies report inhibitory neurons that arc as sharply tuned 
as excitatory neurons. These diverging findings about the selectivity of excitatory and 
inhibitory cortical neurons prompted us to ask the following questions: (1) How dif- 
ferent or similar is the cortical computation with that in previously described species 
that relies on map? (2) What is the network mechanism underlying the sharpening 
of orientation selectivity in the mouse primary visual cortex? Here, we investigate 
the above questions in a computational framework with a recurrent network composed 
of Hodgkin-Huxley (HH) point neurons. Our cortical network with random connec- 
tivity alone could not account for all the experimental observations, which led us to 
hypothesize, (a) Orientation dependent connectivity (b) Feedforward afferent speci- 
ficity to understand orientation selectivity of VI neurons in mouse. Using population 
(orientation selectivity index) OSI as a measure of neuronal selectivity to stimulus ori- 
entation we test each hypothesis separately and in combination against experimental 
data. Based on our analysis of orientation selectivity (OS) data we find a good fit 
of network parameters in a model based on afferent specificity and connectivity that 
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scales with feature similarity. We conclude that this particular model class best sup- 
ports datasets of orientation selectivity of excitatory and inhibitory neurons in layer 
2/3 of primary visual cortex of mouse. 

Introduction 

Neuronal response selectivity for stimulus orientations is one of the key properties that 
mouse VI shares with other species [6, 44, 27, 43, 41]. In higher mammals, anatomically 
close VI neurons have similar preferred orientations (PO), giving rise to orientation 
maps. Orientation maps in turn correlate with the connectivity that is observed in VI 
among all the cell types. The fine-scale organization of mouse cortical microcircuits 
is clearly dissimilar [15, 12, 36]. In particular, receptive fields of layer 2/3 neurons 
were found to be relatively large with high overlap for neighboring neurons [36]. In 
addition, a salt-and-pepper organization of orientation preference exists in layer 2/3 
[18, 37]. Broad tuning of VI cell types is a direct consequence of such salt-and-pepper 
organization[19, 21, 15]. Cortical mechanism for tuning and selectivity of cat and 
monkey VI neurons have been extensively investigated with different category of com- 
putational models so far [29, 35, 12, 41, 38, 24]. In comparison, there are very few 
model based analysis in mouse cortex, lone, a recent model from Hansel et. al. that 
sheds light on the orientation selectivity of VI neurons without a functional map [8]. In 
a previous work, it was established that the experimentally measured response proper- 
ties of cat VI neurons are consistent with the predictions of a Hodgkin-Huxley network 
model dominated by recurrent interactions and with balanced contributions from exci- 
tation and inhibition [24]. However, this cannot rule out alternative cortical operating 
regimes. Subsequently, it has been shown in a recent study, with model-based data 
analysis in VI of cat; that close to pinwheel centers recurrent inputs show variable 
orientation preferences; within iso-orientation domains inputs are relatively uniformly 
tuned. Physiological properties such as cells membrane potentials, spike outputs, and 
conductances change systematically with map location. With this background in mind, 
we would like to turn to model-based data analysis in order to assess a continuum of 
network models, that encompasses the full range from feed- forward via inhibition- 
and- excitation (I-E) dominated models to models with excitation and inhibition in 
balance. Thus, in contrast to many modeling approaches, we try to determine the 
space of models able to account for the data, rather than demonstrating one model 
to be compatible with the data sets. Our computational model is composed of HH 
point neurons with realistic AMPA, NMDA, GABA synapses and a salt-pepper orga- 
nization of VI neurons. Model assumptions are (a) random lateral connectivity, (b) 
Orientation dependent connectivity, (c) Feed-forward afferent specificity, (d) combining 
afferent specificity and orientation dependent connectivity. Our experimental database 
comprise of OSI, 01 values of membrane potential, spike output, conductances of VI 
neurons as published by several recent studies. More specifically, we are using OSI and 
01 values for all four responses (spike, membrane potential, excitatory and inhibitory 
conductance) from in vivo whole-cell voltage-clamp recordings from excitatory cells in 
layer 2/3 of mouse visual cortex [19, 41]. Also, we have used the firing rate excitatory 
and inhibitory population OSI reported by [27, 32]. We carry out a goodness of fit test 
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using K-S test between simulated and experimental OSI distributions. We conclude 
the test results as a good fit if p values are above 0.05 threshold which defines 95% 
significance level. Based on the test results, we conclude that the likely models to 
account for the experimental observations are the models with afferent specificity and 
afferent specificity in conjunction with feature specific lateral connectivity. 

1 Materials and Methods 

Network architecture Over all our network model is composed of three neuron popu- 
lations: Excitatory afferent neurons provide feed forward input to the primary visual 
cortex layer, which is received by an excitatory and an inhibitory neuron populatio (see: 
Fig. 2). Neurons are spread on a two-dimensional D x D grid representing a square 
patch of mouse VI of approximately 0.5 x 0.5 mm^. Every grid point is occupied by an 
excitatory neuron (population size: Ne = D'^), but only every third randomly-selected 
site is occupied by an inhibitory neuron (population size: Nj = Ne/S) is placed. 
Neurons at every site are highly interconnected and receive input from a number of 
feed-forward neurons Na with stimulus specific rates. 

Primary visual cortex neurons Each visual cortex cell is describe by a Hodgkin- 
Huxley-type neuron. It's membrane potential dynamic V is driven by several intrinsic 
and synaptic currents: 

Cm-^ = —gL{y — El) — lint — hyn — hg, (1) 

where Cm is the membrane capacitance, t the time, ql the leak conductance, El 
reversal potential, and lint, I syn, hg are voltage dependent intrinsic, synaptic, and 
background currents, respectively. To account for different membrane properties of 
excitatory and inhibitory neurons the leak conductance ql is selectively specified as 
qel and qil for excitatory and inhibitory neurons. Explicit parameterizations of the 
model are comprised in Table 2 Intrinsic Currents, gating variables, and ion channel 
properties Three intrinsic currents, a fast Na'^ current In a, a delayed-rectified K'^ 
current Ixd and a slow non-inactivating current Im are summed to comprise the 
total intrinsic current to each neuron. Intrinsic currents are based on voltage dependent 
gating variables: 

lY{t) = -gYm^actit)mY\nacmV{t) - Ey) (2) 

where gy is the peak conductance, Ey is the reversal potential, ly,ky number of 
activation and inactivation sites, and my act, myinac are activation and inactivation 
dynamics, with Y G {Na, Kd, AI}. A differentiation of gM for excitatory gEM and 
inhibitory gjM accounts for reduced adaptation of inhibitory neurons. Activation and 
inactivation dynamics are described by: 

tyayi{l — my) — ay2my 

ClC2iV) 
exp(c3(y)) + C4 



dmy 
dt ~ 

Oiyi = 
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For the particular receptor kinetics values from Destexhe &: Pare [5] are used (see: Ta- 
ble 3) Synaptic background current For embedding the small simulated network into a 
larger surrounding cortex each neuron receives an unspecific fluctuating synaptic back- 
ground current Ibg mediated by excitatory {gbgE) and inhibitory {gbgi) conductances: 

hg = gbgE{V{t) - EbgE) - ghgl{V{t) - EbgE) (3) 

which follow a stochastic process similar to an Ornstein-Uhlenbeck process [31]. gbgX 
is given by: 

gbgx{t + dt) = glgx + [9bgx{t)-gbgx\(i^P{-dt/ngx) + ^1 - eyi-p{-2dt / Tbgx)N {Q, abgx) 

(4) 

where g^^^^ is the average conductance, Tbgx is the background synaptic time constant, 
and A^(0, (Jbgx) is a normally distributed random number with zero mean and standard 
deviation ObgX and X G {£^, /}. 

Synaptic currents and receptor dynamics Synaptic currents to each neuron originate 
via lateral connections from neighboring excitatory as well as inhibitory neurons and 
via feed- forward connections from excitatory afferent. The total synaptic current is 
given by 



'■syn 



it) 



^5A(i) +j^iqgElit) + il-q)gE2it)) 



afferent excitatory 



recurrent excitatory 



{V-Ee 



9l_ 
Ni 



gi{t){V-Ei) 



recurrent inhibitory 

(5) 

where all g,N , and g[t) are peak conductance, number of connections, and time 
dependent conductance for the specific type of connection, q quantifies the fraction of 
fast AMPA-like receptors and Ee and Ei are the synaptic reversal potentials. Time 
dependent conductances for fast excitatory gA,9Ei, and fast inhibitory GABAa type 
gj synapses are described by a delayed (by At) exponential response to spikes at time 

tsp- 

9x{t) = ^ye'-^ (6) 



TX 



tk<t 



with tk = tgp + At and tx with X £ {A,E1,I} is the synaptic time-constant. Multiple 
events are linearly summed. For each pre-synaptic neuron and used to all postsynaptic 
neurons one delay value At, which comprise synaptic and conductance delays and 
is drawn from a truncated Gaussian {max{l/ y/liraxA 6xp(— /U^^/2(T^^), dt)), with 
X £ {E,I} and dt the numeric integration time-step. For the slower response kinetic 
of NMDA-type receptors a bi-exponetial description is applied: 



9E2{t) 



tk<t 



e 
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(7) 



where tj and are rise and decay time constants and again multiple events are linearly 
summed. Both types of conductances are normalized so that for a single incoming spike, 
the integral over time is 1. Lateral connectivity 
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Each neuron receives recurrent synaptic input from neighboring excitatory and 
inhibitory neurons. Each excitatory (and inhibitory) neuron gets a fixed number of 
incoming recurrent connections from excitatory Nee {Nje) and inhibitory neurons Nei 
{Nil). Connections are estabhshed by drawing randomly from a 2-d radial-symmetric 
Gaussian probabihty distribution (see Figure 2: 



where x is the distance to the presynaptic neuron (in pixels) and ax with X G {E, /} 
the width of the Gaussian. Connections at the boundaries are build using periodic 
boundary conditions. Salt-pepper architecture of rodent VI 

The "salt-and-pepper" -organization of preferred orientation in rodent primary vi- 
sual cortex is implemented by uncorrelated random assignment of preferred orientation 
to afferent neurons projecting to one site in the visual cortex lattice (to the excitatory 
as well as inhibitory neuron at the same site). As each afferent neuron is only project- 
ing to one site and all afferent neuron projecting to one site have the same preferred 
orientation primary visual cortex neurons inherit preferred orientation from their af- 
ferent. Each afferent neuron is realized as a Poisson process with a stimulus specific 
firing rate: 



where OsUm is the orientation of the presented stimulus, fAmax is the maximal firing 
rate when optimally stimulated, 9 is the preferred orientation chosen according to the 
neuron's location in the artificial orientation map, cTAff is the orientation tuning width, 
and ri,ase is a baseline response without stimulus. C is the stimulus contrast in % (100 
% for all simulations carried out here). 

Numerical procedures and analysis of simulation results 

The network model was implemented in Python™ 2, using simulator for spiking 
neural network Brian, numerical and scientific computing package NumPy and SciPy. 
The simulations were performed for 1.2 s with a fixed time step of dt = 0.05ms. 
The first 200 ms of simulation aimed to set the network to a steady state. Thus, 
the results within this time were ignored. The membrane potential {Vm), the firing 
rate (/), the excitatory and inhibitory conductance {ge and gi) are captured for each 
cells for the last 1 s. The mean membrane potential was calculated by omitting the 
values from 4 ms before until 7 ms after every spike. The mean of this value then was 
subtracted with the resting potential of the cell iVm = — 67.5mV) for calculating the 
sharpness of tuning. The total excitatory conductance ge is the sum of the afferent 
conductance, the recurrent of excitatory conductance of the fast AMPA-like and slow 
NMDA-like excitatory synapses, and the excitatory background conductance. The 
total inhibitory conductance gi is the sum of the recurrent inhibitory conductance of 
GABA^-like inhibitory synapse, the conductance of the non-inactivating K"^ current 
and the inhibitory background conductance. 




for X = (no self-connections); 
■"^ /2a\) otherwise,. 



(8) 




(9) 




(10) 
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Parameter space explorations and model modifications 

In Hodgkin-Huxley network model VI neurons receive both feedforward afferent 
excitatory input which are moderately tuned for orientation and as well as, recurrent 
input from neighboring VI neurons. Four types of recurrent connections are imple- 
mented in VI network namely E to E, I to E, E to I and I to I respectively. Afferent 
input and lateral connectivity are the two key components of this network model. To 
implement it we assume afferent excitation that each VI cell (both inhibitory and exci- 
tatory) receives comprise of A^a// excitatory neurons, which are sufficiently well tuned 
to orientation in the default network (where afferent specificity and feature specific 
lateral connectivity is not introduced). The operating regimes of a ring rate model 
can be quantified based on the strength and shape of the effective recurrent input [1]. 
Results proposed by Kang et al. [1], however, are based on the analytical solution 
of a linear ring rate model where all neurons are above threshold and cannot be ex- 
tended to the non-linear Hodgkin-Huxley network model used here. Hence, we resort 
to numerics in our present study and systematically vary the strength of recurrent 
excitation and inhibition (physiological network parameters) relative to the strength 
of our afferent input to VI cells in order to characterize different operating regimes. 
We carry out a full network simulation with default set of network parameters with 
19 different maximum conductance values of excitatory connection to excitatory [qee) 
and 14 different maximum conductance values of excitatory connection to inhibitory 
neurons (giE), while keeping all other parameters fixed. The maximum conductance 
values are ranging from 0.1 to 1.9 with a step size of 0.1 for qee and from 0.033 to 
2.733 with a step size of 0.2 for gjE- These values are multiples of the maximum af- 
ferent conductance of excitatory neuron g"^^^ ■ The excitatory and inhibitory recurrent 
and afferent input currents were computed for each cell in all parameter combinations. 
Both recurrent input currents were normalized with afferent input current at preferred 
orientation. As described in [25], the operating regimes for Hodgkin-Huxley (HH) net- 
work model can be numerically classified using following criteria: feedforward (FF), if 
the sum of absolute excitatory and inhibitory currents are below 0.3; excitatory (EXC), 
if the excitatory current dominates the inhibitory current for all presented orientations 
and the sum of absolute excitatory and inhibitory currents are above 0.3; inhibitory 
(INH) if the inhibitory current dominates the excitatory current and the sum of excita- 
tory, inhibitory currents are below 0; reccurent (RFC), if the excitatory and inhibitory 
currents are strong and balanced and their sum is approximately 0. 

Tuning of afferent and their specificity to VI neurons By default in our "salt- 
and-pepper" network model each afferent neuron is realized as a Poisson process with 
a stimulus specific firing rate calculated based on Eq.(9) and (10). Afferent tuning 
curves are all based on a Gaussian in Eq.(lO) where the orientation tuning width CTAff 
small. Hence, in this model these excitatory afferent neurons projecting to one site 
in the visual cortex lattice (to the excitatory as well as inhibitory neuron at the same 
site) are sufficiently well tuned. One of the justification for such selection is that the 
recurrency either amplifies or dampens output spike response of cortical cells modestly. 
This we have tested using different afferent tuning width (from small to large). Based 
on our results we have then decided to held CTAff = 27.5° without the loss of any 
generality. 
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Afferent speficity to VI neurons 

Afferent specificity is implemented by adding an untuned afferent excitatory input 
component to receiving VI inliibitory cells. In this case, afferent excitatory firing 
rates are computed using a truncated Gaussian as follows, Let X = (Xi, . . . , Xd) be a 
d— dimensional Gaussian vector with mean and standard deviation cr, and let [oj, 6j] 
be d intervals, where hi may be either a real number or +00. The distribution of X, 
conditional on the event that Xi G [oj, 6^], i = 1, . . . ,d, is usually called a truncated 
Gaussian distribution. First, we consider the problem of simulating a random variable 
9 from a univariate Gaussian density truncated to [9a, 9b): 



Hence, for some truncation point 9a, where <p and ^ denote respectively the unit Gaus- 
sian probability density and cumulative distribution functions. Now, based on Eq.(ll) 
we compute p{9) and substitute in Eq.(lO) for firing rate at a preferred orientation of 
our stimulus 9stim- In order to constrain choice of ^ and a in our formulation we carry 
out a grid search over this 2D parameter space and subsequently compute p values 
based on Kolmogorov-Smirnov goodness of fit test to arrive at optimal values. The 
combination of ^ and a are then selected based on the computed p values to carry out 
further parameter grid search over recurrent excitation and inhibition values (network 
parameters used in each model space). Afferent excitatory input is further splitted 
into 2 components, (a) A^jtuned, {h)Nu untuned, which is received by a layer of VI 
inhibitory neurons. Fraction of tuned vs untuned components are decided again based 
on a grid search. They are held fixed throughout the afferent specific simulations are 
concerned. 

Measures of selectivity, analysis of simulated data and fit 

The orientation selectivity were measured with Orientation Selectivity Index (OSI), 
Orientation Modulation Index (OMI) and Orientation Index (01). The OSI is given by 



where 9 is the angle of stimulus ranging from -90° to 90", R{9) is the quantity of 
response as the stimulus was presented. The value of OSI is ranging from to 1. If the 
response is only significant to one stimulus orientation (its preferred orientation), the 
OSI will have value 1. Whereas, if the responses are equal to all presented orientation, 
the OSI is equal 0. In this study, the OSI quantified the orientation selectivity of 
the mean membrane potential {Vm), the firing rate (/), the mean excitatory and 
inhibitory conductances {g^ and gi). The background conductance were excluded from 
both mean conductance for calculating the OSI. The OSI is also used to determine 
orientation selectivity of recurrent input received by a neuron based on its position on 
the map, which is referred as map OSI. This map OSI is calculated by binning the 
orientation preference of all pixels within a fixed radius around a neuron into bins of 





[40]: 



OSI 
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10° size. The number of cells in each bin replaces the quantity of response R{9). This 
study used a radius size of 10 pixels , instead of 8 pixels( ^ 250 fJ.m), which is described 
by [39]. The choice of 10 pixels was based on the saturation of the intercept of OSI-OSI 
regression line (see for further details [39]) (data not shown). 
The experimental OSI often defined as in [27] 

QSJ^ ^Pref-Rortho ^ (13) 

where, Rpref is the peak response in the preferred orientation, and Rortho is the response 
in the orthogonal direction. Orientation selectivity index (OSI) representing the tuned 
versus untuned component of the response. We rename the above measure here as 
OMI in order to avoid any confusion with OSI already introduced in Eq.l2 
The 01 as defined by [41]: 

N 

OI = l-- (14) 

where N and P are the quantity of response to null (orthogonal) orientation and the 
preferred orientation, respectively. The 01 is used to quantify the tuning of the mean 
excitatory {g^) and inhibitory (gi) conductance. The background conductance are 
included in both mean conductance. 

Goodness of fit and nonparametric test 

A two-sample Kolmogorov-Smirnov (K-S) test is to compare the distributions of 
the values in the two data vectors. The null hypothesis is that compared datavectors 
are from the same continuous distributions. The alternative hypothesis is that they 
are from different continuous distributions. Statistics aim to assign numbers to the 
test results; p- values report if the numbers differ significantly within p < 0.05 at the 
5% significance level and p < 0.001 at the 1% significance level. We reject the null 
hypothesis if p is "smaller" than this number. 



2 Results 

Experimental data on orientaion selectivity are nonoverlapping and mixed 

Population histogram of OSI, OMI and 01 distributions for all visually responsive 
cells from various experimental datasets are plotted in figure 1. Histograms are ob- 
tained using different measures of orientation selectivity and shows vast difference. In 
figure 1 (A and B) excitatory firing rate OSI and OMI admits broad range of values. 
Same for the firing rate OSI and OMI for inhibitory populations. Compared to fig- 
ure(lA) in figure(lD)firing rate OSI distributions are much more skewed and admits 
only medium to high OSI values as reported by Tan et. al. [41]. On the contrary, 
firing rate population distribution from Liu data largely overlaps with figure 1(A) from 
Runyan. To check the consistency among the reported orientation selectivity data, we 
have estimated p values using two sample Kolmogorov-Smirnov (K-S) goodness of fit 
test between various selectivity distributions (firing rate selectivity of excitatory and 
inhibitory neurons, membrane potential, excitatory conductance, inhibitory conduc- 
tance of excitatory neurons). Test results with p values between cross-experimental 
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datasets are then tabulated in Table 1. From table 1 we find that the firing rate OSI 
of excitatory populations as reported by Tan et. al. is significantly different from Liu, 
Runyan, Niell et. al. [19, 27, 32] as the computed p values are less than 0.001 for all 
cases. Excitatory and inhibitory conductance OSI and 01 distributions between Liu 
and Tan data respectively gives p values greater than the threshold set at 0.05. Hence, 
we conclude they are a good fit. P values from membrane potential OSI distributions 
for excitatory population between Liu and Tan data falls below 0.05 cut off and hence, 
the two distributions are different. P values computed for firing rate OSI and OMI 
distributions of excitatory population between Runyan and Niell are below 0.05 and 
hence, these distributions are different. On the contrary, p values from inhibitory OSI 
distributions among the same data sets are significant. P values computed for firing 
rate excitatory OMI, OSI distributions reported by Niell compared with Liu data are 
below the threshold value set at 0.05. We conclude many of the response measures are 
consistent with each other, while, others are completely nonover lapping. 
Network with salt-pepper architecture gives spike selectivity 
Parameter space exploration reveals various dynamical regimes of salt-pepper net- 
work model 

Network parameter space exploration results are plotted in figure 3(A) character- 
izing the operating regimes and the various regime boundaries estimated using total 
excitatory and inhibitory currents received by VI neurons, respectively. Each of the 
parameter regimes displays a characteristic relation between the OSI of the output 
rate membrane potential, spike, the excitatory and the inhibitory conductance, and 
the tuning of the local input area (map OSI). Typical examples of these relationships 
are reported in [39]. Salt-and-pepper network shows its stability at high parameter 
combination of recurrent excitation, inhibition values (near the right corner) and has 
a small inhibitory regime. The region shown above the green solid line in figure 3(A) 
corresponds to an unstable regime. In this regime the average firing rate of neurons 
are above 100 HZ. 

Total excitatory and inhibitory input currents to VI cells characterize parameter 
boundaries 

Estimated total excitatory and inhibitory synaptic input currents (Afferent exci- 
tatory plus excitatory and inhibitory recurrent inputs measured for all VI cells) for 
four arbitrary points (shown in red dot in the characterized map) of figure 3(A) are 
then plotted in figure 3(B),(C),(D) and (E). Blue solid line indicates total excitatory 
current to VI cells, red line indicates total inhibitory currents and black line is the total 
aggregate current (which is a sum of total excitatory and inhibitory currents). Total 
input aggregate current defines the operating regime of a given network. Similar to the 
orientation tuning curve, the normalized input currents were aligned to the preferred 
orientation, which were set to 0°. It is important to note that in the salt-and-pepper 
network, the cells receive collective recurrent input from their neighboring cells which 
have diverse orientation preferences (local map OSI). Hence, these input currents are 
not pronounced at the preferred orientation (0°). Conceptually this is quite similar to 
the diverse orientation preferences of adjacent cells at any pinwheel center in a pinwheel- 
domain network, the recurrent input received by these cells have similarity to the cells 
in salt-and-pepper network. In our model class with random connectivity every exci- 
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tatory and inhibitory cortical neuron received well-tuned time-invariant afferent input, 
with a reduced afferent input strength for inhibitory neurons. The synaptic strengths 
(maximum conductance values) of excitatory connections to excitatory {qee) and in- 
hibitory cells {qie) were varied systematically, keeping all other parameters constant. 
For each such model parameterization, we determined the best-fitting regression lines 
for the OSI of Vm, f, ge, and gi as a function of the local input map OSI. Subsequently, 
log of p-values for OSI and 01 distributions {f,Vm,ge,gi) are validated against experi- 
mental database for each such parameterization as described above for our HH network 
model. Computed p values on a log scale are then embedded on a 2d parameter space 
9ee, giE as shown in figure 4 A, B and C. In the figure, the region of the parameter 
space bounded by black solid line provides the goodness of fit against experimental dis- 
tributions. The region bounded by this black solid line assumes p values greater than 
0.05 cutoff (Within 95% confidence interval for a p value cutoff set at 0.05). Our net- 
work as described before has an unstable regime where the average firing rate exceeds 
100 Hz (above the thick solid green line), we refer to the regime as unstable because the 
network shows self-sustained activity, i. e. the network activity remains at high firing 
rates if the afferent input is turned off. We do not evaluate the p values in this region. 
More specifically, network simulation yield p values that are above the p value thresh- 
old set at 0.05 against the Liu data sets for (Vm, ge, Qi) OSI distributions in figure4 A. 
We have a good fit for our network parameters residing mostly in a recurrent operating 
regime [21] for a relatively higher combination of synaptic strengths (maximum conduc- 
tance values). We don't find any significance boundary against Liu's firing rate OSI 
distributions as indicated by figure4 A. Network parameters from excitatory operating 
regime offers good fit against all Tan data sets. Combination of maximum conductance 
values are on the higher side of the grid (see 4B). Not too surprisingly, simulated OSI 
distribution for firing rates are different from experimental OSI and OMI distributions 
as reported by [27, 32], which is shown in the figure 4 C and D. From the above results, 
it is quite clear HH network model with chosen recurrent parameter grid with default 
network parameterization cannot capture all the relevant OSI, OMI distributions in 
particular for response properties such as firing rate selectivity of VI neurons. The 
reported values of inhibitory spike OSI and OMI are a complete mismatch. One of 
the main reason for the above difference could be the following. While, Tan(2011) and 
Liu (2011) et. al. suggest that inhibitory cells are broadly tuned for all orientation 
and excitatory cells are more sharply tuned, Niell (2008), Runyan (2011) et. al.(see 
figure 1) experimental data seems to suggest that both inhibitory and excitatory cells 
have a range of OSI values and hypothesize presence of subtype of inhibitory cells in 
the visual cortex [32]. Hence, the overall response specificity may be highly related 
to the interneuron subtype specificity and their connectivity to other cell types in the 
same layer of cortex. Validation against experimental data suggest that the most likely 
combination of maximum conductance values (qee, Qie) resides in a regime close to 
the boundary of recurrent and excitatory regime. Next, we look at the overall orien- 
tation selectivity for all Ne = 2500 excitatory and Ni = 833 inhibitory neurons for 
such a point of our network characterized by qee = 1-5, qie = 2.4. Excitatory and In- 
hibitory population distributions for four response properties {f,Vm,ge,9i) are shown 
in figure 5. In figure 5 OSI distribution of membrane potential selectivity is skewed 
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towards zero. Intriguingly, spike output response (for excitatory neurons in green and 
inhibitory neurons in red) are highly selective. Both excitatory and inhibitory conduc- 
tances are broadly tuned for orientation. It appears that moderate afferent tuning of 
both populations by and large dictates their firing rate output response. Compared 
to figure 1 we have good agreement with experimental distribution of OSI, 01 values 
published by Liu, Tan et. al. respectively [21, 41]. The median of the membrane 
potential OSI (median=0.0851) and mean of inhibition 01 (mean=0.2929) are similar 
to their results, while the excitatory conductance 01 values (mean=0.4383) is slightly 
higher than their result. Instead, if we select network parameter values gEE, 9iE from 
excitatory regime of our parameter space, the median of firing rate OSI distribution 
resulting from simulation (median=0.3292, 0.0129 < OSI < 0.5588) is consistent with 
their result. The median of membrane potential OSI (median = 0.0734) is slightly 
lower, while the mean of excitation 01 (mean=0.3626) and the mean of inhibition 01 
(mean=0.2400) are similar to their results. On the contrary, our simulated distribution 
is vastly different compared to OSI distribution of firing rates for both excitatory and 
inhibitory population as published by Niell, Runyan et. al. [27, 32]. Their data shows 
overlapping and a range of OSI, OMI values. In our data of spike output responses 
such diversity in orientation selectivity is not reflected inspite of the diversity present 
in our salt-pepper map model of VI. 

Significance boundary grows with orientation dependent connectivity 
We argue based on the previous set of results substantial modification in model 
assumption is necessary to account for maximum amount of experimental observations. 
One of the plausible modification in this direction could be to incorporate a different 
lateral connections to extend our model space. To address this systematically we 
introduce fine scale specificity in the lateral connections based on numerous recent 
data published by [47, 46, 14]. Authors clearly suggest that in VI most of the layer 
2/3 pyramidal cells responds typically selectively to oriented grating stimuli, most 
probably reflecting their nonrandom connectivity. Moreover, several recent studies 
that combined in vivo two-photon calcium imaging with post-hoc paired whole-cell 
recordings in brain slices reported evidence for functional sub-networks of neurons 
expressing similar orientation tuning [46, 14]. Taking into account the above flndings. 
We have investigated a model space with specificity in lateral connectivity between 
excitatory-excitatory pairs and keeping the afferent input to the cells unchanged from 
default parametrization. 

Local connectivity structure between exc/exc pairs in VI is illustrated in figure 6(b) 
which has a fairly reasonable degree of resemblance with Hofers data in [10] . Orienta- 
tion dependent connectivity as exemplified in figure 6(b) are drawn from a triangular 
distribution. In order to quantify the network selectivity of neuronal responses we com- 
pute OSI values across all excitatory and inhibitory neurons. We systematically record 
four different response properties membrane potential, excitatory and inhibitory con- 
ductances (subthreshold responses) and also firing rate (suprathreshold responses) OSI 
for all excitatory neurons respectively. We carry out a full network parameter search 
as in the previous section to validate simulated network data against experimental dis- 
tributions. We use identical network parametrization as before. Log of p-values using 
K-S test are plotted in figure 7 which extends significance boundaries in figure 7 A, 
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compared to the test results for Vm, Qe, di, the Liu data sets plotted in figure 4 B 
(White and sky blue colours in our colormap corresponds to statistical significance (p 
> 0.05)). Significance boundary (Within black enclosed line (p > 0.05))also grows in 
figure(7 B) in comparison with the Tan data sets in figure (4 B). All possible combi- 
nations of maximal conductance values qee, 9ie embedded in recurrent regime of our 
network concurs well against Liu data Vm, Qe-, gi OSI distribution. On the contrary, 
we have more excitatory points in our search grid that concurs against the Tan data 
for Vm, ffe; ffi) /■ Our model space do not show any significance boundary against Liu, 
Runyan, Niell firing rate OSI, OMI values for excitatory population and Runyan firing 
rate OSI values for inhibitory population. There are few points mostly residing on 
the boundary of excitatory and recurrent regime that corresponds to significant values 
(p > 0.05) computed for inhibitory spike OSI distributions against Niell's OMI values 
as shown in figure (7D). There is atleast one point from the recurrent regime of our 
network qee = 1-5, giE = 2.54 which can account for entire data sets of Tan and 
partial data set of Liu and Niell. We plot histograms for all response properties and 
for all cells in VI for network parameter combination selected from above. Results are 
shown in figure (8). From the distribution, we find compared to figure 5), in figure (8) 
membrane potential Vm and excitatory conductance ge OSI distribution for excitatory 
cells (shown in green) have higher selectivity (mean Vm OSI = 0.28 and ge OSI = 0.26). 
Same distribution for inhibitory cells (shown in blue) show broadly tuned but a range 
of orientation selectivity as the distribution spreads. Mean / OSI = 0.45 has lower 
value compared to mean / OSI = 0.74 in the default case. Inhibitory conductance gi 
values seems to be affected the least and shows a characteristic skewed distribution for 
both cell types as compared to the gi values (mean gi OSI for excitatory cells 0.1368 
and mean gi OSI for inhibitory cells 0.0763) figure (5). Excitatory conductance and 
membrane potential orientation selectivity mean values are practically identical result- 
ing in co-selectivity for stimulus orientation. Spike selectivity for inhibitory cells are 
strikingly different compared to the data in figure (5). In this case, the inhibitory 
distribution is broad and has a wide range of orientation selectivity. Inhibitory pop- 
ulation receives local recurrent input from excitatory cells (local map input OSI is 
diverse) in a nonorientation dependent manner and comprise of diverse tuning of exci- 
tatory conductance values. As the recurrent interactions are mediated by conductance 
changes therefore more spread in the excitatory conductance leads to more spread in 
the inhibitory spike selectivity. On the other hand, mean spike selectivity of excitatory 
cells are sharply tuned as they sample input from overall broadly selective inhibitory 
population. Model space with lateral connection specificity assumption definitely gives 
more network parameters that can provide fit against many datasets in our experimen- 
tal database, however; this assumption alone is certainly not sufficient to account for 
may other datasets. To, investigate this further, we introduce a second modification of 
our network by adding an untuned component of excitatory afferent to VI inhibitory 
neurons. 

Adding an untuned component of excitatory afferent can account for 
maximal number of experimental observations 

Model classes described in the previous two sections assume feedforward afferent 
input to all VI cells are strongly co-tuned for orientation. However, recent studies 
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based on the response properties of layer 4 (a major thalamocortical input layer of VI) 
interneurons suggests functional differences between two inhibitory subtypes somato- 
statin (SOM) and paravalbumin (PV) neurons[22]. Their results suggest that SOM 
and PV have differential tuning in layer 4: while PV neurons are untuned for orienta- 
tion, SOM neurons are as sharply tuned as excitatory neurons[22, 23]. Here, we have 
hypothesized that all the excitatory cells and a fraction of the inhibitory cells in VI 
receive co-tuned excitatory afferent input and the remaining fraction of the inhibitory 
neurons receive weakly tuned afferent excitatory input. For our proposed feedforward 
architecture, we have used = 70% weakly tuned and Nt = 30% tuned excitatory 
afferent input in order to introduce differential tuning to inhibitory neurons in VI (see 
materials and methods). To make it more transparent, orientation selectivity of affer- 
ent input received by excitatory and inhibitory neurons are shown in figure 9. Due to 
the presence of tuned and untuned components, afferent input to VI interneurons has 
a multimodal distribution as shown in figure (9 B). Afferent mean firing rates are com- 
puted using a probability of distribution based on a truncated Gaussian of fixed mean 
and width as defined in Eq.(ll). In order to reduce free parameters and find optimal 
values for fj, and a we carry out a coarse grid search. We vary Hexc and fimh from to 80 
in a step size of 20 and held aexc = 27.5 and ainh = 27.5 fixed. Subsequently, we com- 
pute the firing rate of all cortical excitatory, inhibitory cells and compute corresponding 
p values based on a K-S test against experimental datasets for OSI, OMI distributions 
from Runyan, Niell. Log of p values are then plotted on a 2D grid as shown in fig. 10 
D. Based on the grid search p values are most significant in a range of fiexc = 10 — 20 
and fiinh = 35 — 40. Similarly, we carry out a grid search over aEx and ainh by holding 
other two fi parameters fixed and also, resorting to default network parametrization. 
Results of log of p values computed against Liu, Tan and Runyan values are shown on 
this grid in figure. (10 A, B, C). Liu data in figure (10 A) indicates that optimal values 
for aEx between 10-30 and that for a^h varies over a range of values. On the contrary, 
against Tan data sets we get optimal values for higher combination of aexc and a^nh 
respectively. We set optimal aexc = 22.5, ainh = 40 based on the rationale that this 
is one of the combination that provides goodness of fit against (p > 0.05) (blue/white 
colours corresponds to higher significance in the colormap used here) maximum num- 
ber of experimental observations. Afferent input OSI distributions are drawn with the 
following four input parameters; aexc = 22.5, ainh = 40, Hexc = 20, fiinh = 35 respec- 
tively. In order to quantify selectivity of our VI network with this model space we 
compute OSI values as before for spikes (for both excitatory and inhibitory neurons), 
membrane potential, excitatory and inhibitory conductances (subthreshold selectiv- 
ity) for all excitatory neurons. Subsequently, we repeat our analysis by performing a 
two sample K-S test against experimental OSI distributions for five different response 
properties. We perform this test for all parametrization of recurrent excitation and 
inhibition values gEE,giE- 

As in the previous section those log of p values which are (p > 0.05 ) significant are 
enclosed with black solid line. In figure (11 A) log of p values on the 2D grid of network 
parameters qee, giE can account for Liu Vm, /, Qe and gi OSI distributions mostly at 
the recurrent operating regime of our network. There are many points spanning differ- 
ent operating regime that provides goodness of fit against Liu firing rate distributions. 
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In fact, almost all the points below black solid line indicates significance (p > 0.05). 
There is atleast one point qee = ^-4:5, gjE = 2.45 which satisfies the entire data set and 
close to the point qee = 1-5,(77_b = 2.5 we found previously in our investigation with 
lateral connection specificity. Compared with figure 4 B and 7 B this class of model 
has larger area of network parameters that can account for Vm OSI (All significance 
points above black solid line in figure (IIB)). Figure (11 B) Tan data shows network 
combinations are mostly from excitatory regime for /, and gi which is in line with 
the findings from previous two model space. Most significant areas of the parameter 
space is color coded in blue/white. Excitatory and inhibitory spike OSI distribution 
from Runyan in figure (11 C) is significant (p > 0.05) in the entire area below the 
black solid line, and in the enclosed region; in the inhibitory plot. Different operating 
regimes of our network namely (excitatory, recurrent and inhibitory) commensurates 
with experimental distributions from Runyan et. al.([32]). Network parameters in the 
high excitatory regime concurs against Niell's data for inhibitory / OMI values. We 
don't find in the area searched almost no points that concurs well with excitatory / 
OMI data. The point which provides goodness of fit across studies is situated almost at 
the boundary of recurrent, excitatory and unstable regime; it's maximal conductance 
value corresponds to gEE = 1.56, gjE = 2.5. One of our key finding is shown in figure 
12, that the presence of an untuned component of excitatory afferent predicts a range of 
orientation selectivity for both excitatory and inhibitory populations in layer 2/3 of pri- 
mary visual cortex. Results of the output population histograms for different sub and 
suprathreshold response properties are shown. Inhibitory spike selectivity show multi- 
modal distributions suggesting existence of both broad and highly selective responses 
among these cell types (mean / OSI = 0.72 for excitatory cells and mean / OSI = 0.50 
for inhibitory cells ). Based on the afferent input distribution shown in figure (9 A, B) 
it further enhances the dependence of VI output responses via afferent specificity alone. 
Output responses correlates with specificity of afferent input. Excitatory neurons spike 
OSI also have a range of values suggesting they pool recurrent inputs from inhibitory 
neurons of diverse orientation selectivity. Distribution shown in figure 12 reproduce 
experimental distribution of spike selectivity (inhibitory and excitatory spike OSI in 
[32]) sufficiently well as can be seen from visual inspection. Mean excitatory OSI = 
0.72, mean inhibitory OSI = 0.50 values also overlaps well with their reported values. 
Compared to spike selectivity data subthreshold response properties such as membrane 
potential (Vm OSI), excitatory (g^ OSI), inhibitory (giOSI) are all broadly selective 
and assumes values that are comparable with the mean values that resulted from the 
simulation of previously described model assumptions. Afferent specificity with 
recurrent fine scale connectivity can account for experimental observations 
Afferent specificity assumption is investigated with default network parametriza- 
tion. Now, we would like to extend this by incorporating two assumptions and extend- 
ing our network model space. Two assumptions are afferent specificity in combination 
with lateral connection specificity. To this end, We first compute the p values as be- 
fore between simulated and experimental OSI distributions for five different response 
properties (/ excitatory, / inhibitory, Vm, ge, Qi)- Subsequently, computed log of p 
values are plotted on a 2D grid of network parameters gEE, 91 E as shown in figure 
(13 A, B, C, D). Compared with previous network validation shown in figure (4A) 
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and (7 A) model space for values taken from membrane potential /, Vm, Qe and gi 
response data from Liu concurs well. All the areas under the black solid line in the 
figure for /, g^, gi gives significant values (p > 0.05) which spans almost three regions 
in the parameter space. Compared to figure 11 A, spike selectivity data shows higher 
log of p values indicating network with afferent specificity has a better match against 
Liu's spike selectivity distribution. However, this network class gives slightly improved 
match against g'e, gi OSI distribution data from Liu as can be seen from the log of p 
values in figure 13 A in the recurrent regime of our network. For, Vm OSI data this 
model space shifts the significant values more towards excitatory regime. We also find 
this interesting shift in g^., gi data. For gi data, parameter region with significant p 
values shrinks. Network seems to give more significant p values for higher combination 
of gEEi giE in the recurrent regime of the network. Compared to figure (4 B) and (7B) 
this class of model gives improved p values against all four response properties by Tan 
et. al.[41]. However, compared with figure (11 B) there is no significant qualitative im- 
provement in the figure (13B). Figure (13C and D) shows spike selectivity for the entire 
network. Spike selectivity for excitatory cells from Runyan et. al. [32] is significant (p 
> 0.05) over various dynamical regime. On the other hand, inhibitory spike selectivity 
is significant mostly in the recurrent and inhibitory regime of this network (far less re- 
gion of significance compared to the excitatory spike selectivity). Niell's data for spike 
selectivity of inhibitory cells shown in Figure (13 D) show more significant p values for 
high parameter combinations mostly extracted from excitatory and recurrent regime 
of our network. This model space shows small improvements in the log of p values for 
spike selectivity of inhibitory cells against Niell's data, however, slightly deteriorated 
log of p values compared to spike selectivity data by[32]. Population histograms in 
figure (14 A, B, C, D) are plotted for one of the recurrent point gEE = 1-5, giE = 2.5 
of our network which satisfies maximal constraints (orientation selectivity distribution 
for intercellular responses from various data sets). Histogram of spikes for excitatory 
and inhibitory population show substantial selectivity. Distribution has lesser propor- 
tion of inhibitory neurons which are very highly selective as compared to the spike 
distribution data in figure 12. As a result, mean inhibitory spike OSI fosi = 0.4361 
is much lower compared to the mean value shown in figure 12. This could be due to 
increase in recurrent input from neighboring cells with diverse orientations. There is 
also a slight increase in the mean spike OSI of excitatory population and likely due to 
higher proportion of excitatory neurons with very high selectivity. Fine scale recur- 
rent connectivity increases excitatory conductance, mean g^ OSI value for excitatory 
neurons as shown in figure 14 compared with figure 12 (with green bar). As E to E 
interactions are mediated via synaptic conductance changes, high selectivity in g^ OSI 
also show enhanced spike selectivity for the excitatory population. 

3 Discussion 

Exploration and validation of model parameter space, regime with heterogeneity in the 
datasets 

In this article, we assessed, which cortical operating regime and model space based 
on biologically plausible assumptions are more well-suited to explain the dependence 
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of orientation tuning and selectivity properties of mouse primary visual cortex. Many 
recent experiments Runyan et. al. [32], Tan et. al. [41] with intracellular mea- 
surements quantify for the same neurons: (1) input (total excitatory and the total 
inhibitory conductance), (2) state (subthreshold tuning of the membrane potential), 
and (3) output (spike response). We selected this particular data set because access to 
both, sub-and-superthreshold tuning, recorded for the same neurons with high laminar 
specificity. A key to constraining our network model space. Spike output response (for 
excitatory and inhibitory population) alone, for example, constrained several model 
space and network parameter values within a particular model space. Moreover, as 
shown in figure (13 C) spike output is compatible with wide range of excitation and 
inhibition values. This is also true for investigation with afferent specificity assump- 
tion alone. We systematically varied the strength of recurrent excitation and inhibition 
values relative to the strength of the afferent conductance values in a biologically more 
plausible Hodgkin-Huxley network model. We have investigated network parameter 
combination of recurrent excitation and inhibition values embedded in a specific re- 
gion of the parameter space those satisfies maximum number of data constraints based 
primarily on orientation selectivity. For all types of models, our finding suggests that 
recurrent regimes dominated by relatively high maximal conductance values can sup- 
port maximum number of experimental distributions. These are important to know for 
reproducing the experimental results. This regime consist of excitatory and inhibitory 
components balancing one another and dominating the afferent input drive. Due to 
the strong recurrent drive, the most likely excitation and inhibition values are located 
close to a region in parameter space where the network settles into a state of strong, 
self-sustained activity. Recently Hansel et.al. have shown that VI cortical networks 
without having any reliance on a functional map can generate sharp selectivity while 
operating on a balance regime of the network, even though anatomically close cells 
have diverse POs [8]. In our network investigations with a salt-pepper map model, in 
which the lateral connectivity depends only on anatomical distance, the excitatory and 
inhibitory population show high selectivity close to the recurrent operating regime for 
Liu datasets (see for {Vm,ge,9i) OSI distributions in figure (4 A) ) but for the Tan 
datasets figure (4 B), network satisfies maximal number of constraints in an excitatory 
regime. Moreover, afferent input specificity to VI inhibitory neurons allowed us to 
test directly to what degree emergence of orientation selectivity is largely independent 
to the degree of orientation selectivity in the input layer as found by Hansel and van 
Vreeswijk (2012) et. al.[8]. We find on the contrary, spike output responses are highly 
dependent on the input tuning. Our null hypothesis about the afferent specificity is 
crucial. In fact, adding an untuned component to excitatory afferent input to VI in- 
hibitory population can account for majority of the experimental data discussed here. 
Clearly, the spike output responses for both excitatory and inhibitory population as 
shown in figure (12) correlates with the structure and type of distribution of their re- 
spective inputs (unimodal for excitatory and bimodal for inhibitory) (see figure (9A 
and B)). Recurrent connectivity plays a less dominant role in this model space. Input 
tuning by and large dictates output responses. This is further raising the possibility 
of an alternative mechanism for orientation selectivity of VI neurons in mouse visual 
cortex. 



16 



Afferent specificity to inhibitory population in vl modulates visual response 
Inhibition play critical functions in shaping spontaneous and evoked cortical ac- 
tivity, and hence inhibitory interneurons have a key role in emergent properties such 
as orientation selectivity in cortical circuits [19, 32, 27]. In the visual (and other 
sensory) cortex, inhibition appears to have a very important role in influencing the re- 
ceptive field properties of neurons. The role of inhibition in shaping response features 
such as orientation selectivity [9, 17] has been difficult to resolve unequivocally, due 
in part to multiple nonlinear properties (importantly, the spike threshold) available 
to cortical neurons for integrating inputs and generating selective responses [41]. The 
tuning of inhibitory inputs to an individual neuron is variable [16, 26] and depends at 
least partly on the location of neurons within relevant feature maps [24]. Even less 
is known about the role of inhibition in the mouse visual cortex, which lacks orien- 
tation columns [6, 44] and may therefore require additional inhibitory mechanisms. 
Orientation tuning of inhibitory neurons in mouse visual cortex has been described 
as generally broader than that of excitatory neurons [21, 19, 15]. However, careful 
analysis of paravalbumin-expressing interneurons using targeted recordings from single 
marked cells demonstrates that they have a range of tuning properties, including very 
sharp orientation selectivity [32, 27]. We have proposed here a model hypothesis with 
afferent specificity, which somewhat related to what is suggested by recent physiolog- 
ical studies, which has emphasized the role of both a tuned and untuned inhibitory 
component in the generation of orientation selectivity [17, 30], that could be realized in 
layer 4 by two functionally different groups of inhibitory interneurons [9, 28]. We have 
tested the influence of an untuned afferent input component on orientation selectivity 
and tuning of excitatory neurons in VI. We find by marginalizing inhibition in this way 
a range of orientation tuning for VI inhibitory neurons can be fitted which is consistent 
with the findings from paravalbumin-expressing interneurons by Runyan et. al. [32]. 
Further, our computational model guarantees in a sparsely connected network pres- 
ence of differential input tuning to inhibitory cortical cells is sufficient for explaining 
diverse orientation selectivity of cortical cell types. In general, dendrite targeting vs 
soma targeting subclass of interneurons may have a precise functional role in dividing 
orientation selectivity of neurons in VI. It would be pertinent to investigate this in 
a more complex class of model having multi compartments to properly characterize 
the functional role of interneuron cell types. This is indeed one of the shortcoming 
of our model fitting approach. However, we can still show specific modulation of vi- 
sual responses of VI cell types due to the presence of differential tuning of cell types 
(excitatory and inhibitory)in the same local circuit. 

Contribution of broadly tuned inhibitory neurons on contrast invariant tuning 
Early modeling studies proposed mechanisms such that inhibition from neurons 
with orthogonal orientation preferences (Wrgtter and Koch, 1991; Sabatini, 1996) 
might suppress activation at nonpreffered orientation[45, 33]. Similar proposed mech- 
anisms relied on broadly tuned (Troyer et al., 1998) or untuned (Lauritzen and Miller, 
2003) inhibition [42, 17]. Although, we haven't shown here any data for contrast invari- 
ance of tuning width; we report here briefly that our preliminary findings in the mouse 
visual cortex model space with afferent specificity is consistent with this early propos- 
als. In general, in the present implementation of our model afferent input tuning width 
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is independent of contrast. However, effect of stimulus contrast can be incorporated 
in our network readily by altering the baseline of afferent firing rate of 30 Hz by sys- 
tematically changing the contrast dependent factor in Eq.(9). The increase of stimulus 
contrast in the network model with afferent specificity increases the afferent input to 
the neurons in VI, which might increase the spike response at non-preferred orientation. 
The broad or almost untuned inhibition resulting from widening of the tuning width 
of afferent input to inhibitory cells in VI is capable to suppress this spike response at 
non-preferred orientation. The networks with broader standard deviation of afferent 
input ainh are more contrast invariant compared to the others. Thus, this observation 
would agree with the hypothesis by [20], which stated that the contrast invariant in 
mouse VI is achieved primarily with contrast-dependent modulation of inhibitory tun- 
ing strength. We find in our data (not shown) most of the tuning curves exhibit their 
contrast invariant at least by 50% contrast. Hodgkin-Huxley salt-and-pepper model 
space with default parametrization also entails the possibility for contrast invariant 
tuning. More recently, it has also been proposed that not the network connectivity 
but the properties of the transfer function, converting synaptic inputs into firing rate 
are responsible for achieving contrast invariant tuning. In vivo transfer functions are 
well approximated by power-law functions (Anderson et al.; Finn et al.) [3, 7] and 
similarly, transfer functions in the Hodgkin-Huxley model with default parametriza- 
tion of the network presented in this study are also well described by a power-law 
function for membrane potential values higher than a certain threshold (see materials 
and methods), one way to change this threshold would be to elevate intrinsic noise 
which would perhaps result in the shift of this threshold, and thereby, preserving the 
contrast invariance for a larger range of contrasts. Mechanisms other than noise that 
can promote contrast-invariance in our model space with default parametrization is 
by allowing low-contrast stimuli of preferred orientation to result in spiking responses 
whereas high-contrast stimuli of the orthogonal orientation not resulting in any spiking 
activity at all. 

Species difference in orientation selectivity of neurons 

In cat VI, the excitation and inhibition conductances are organized in push-pull 
model, where the increase of excitation decreases the inhibition, and vice versa [2]. 
Both inhibition and excitation have similar preferred orientation and tuning width, 
which indicate that the cells receive input from neurons with similar orientation tuning 
[2]. In contrast, the VI cells in mouse VI receive inhibitory inputs from the inhibitory 
neurons, whose receptive fields have larger size and weaker orientation tuning compared 
to excitatory neurons [19]. Our model space with feature specific connectivity decreases 
the orientation selectivity of inhibitory neurons and sharpens the orientation selectivity 
of excitatory neurons. This result is consistent with that described by [20] as shown 
using a K-S test in figure (7 A), which suggested that the broadly tuned inhibitory 
neuron increases the orientation selectivity of membrane potential plotted in figure 
(8). Measuring membrane potential fiuctuations can also shed light on the origin of 
strong OS near pinwheels [24, 34] in the orientation map of cats and monkeys [4, 11]. 
If the probability of connection depends mostly on the anatomical distance, neurons 
near pinwheels will integrate inputs from cells with diverse POs. In our model, when 
we measure the total aggregate input excitatory plus inhibitory currents to VI cells we 
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find integration of input is comparable to pinwheels in cat. In line with the proposal 
that each VI neurons in layer 2/3 integrate spatially distributed inputs which code for 
many stimulus orientations [13]. It is important to emphasize that aggregate input is 
determined primarily by two factors: (a) the diversity in local map OSI of the individual 
presynaptic cells, (b) the tuning width of those presynaptic inputs. In order incorporate 
diverse tuning width in the model with afferent specificity, we have splitted excitatory 
afferent input into two groups. Each group is tuned differently than the other group 
resulting into parallel input channels that carries information about different tuning of 
orientation to a group of inhibitory neurons located in VI. This model assumption is 
in line with the recent finding from Gao et.al. (Gao 2011) where they argue neurons in 
mouse VI receive inputs from a weighted combination of parallel afferent pathways with 
distinct spatiotemporal sensitivities. These model assumptions could demonstrate that 
inhibitory neurons have similar degrees of orientation selectivity as excitatory neurons 
in VI consistent with the finding from [32] . 

In conclusion, we make the following testable predictions, (a) Feedforward excita- 
tory inputs to interneurons in mouse VI are divided into tuned and untuned channels. 
In general the role of inhibition in generating response selectivity as a component of the 
cortical computation remains elusive. With afferent specificity we find shared selectiv- 
ity for excitation and inhibition may act to sharpen orientation selectivity. Inhibition 
may also contribute to selectivity by acting as a gain control mechanism. Our model 
prediction can be tested by looking at the firing rate response gain for VI inhibitory 
cell types and see if there exist any observable difference between the cell types that 
receives tuned versus untuned afferent presynaptic inputs. 
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Figure 1: Histograms of OSI of spikes, membrane potential, inhibitory and excitatory 
conductances are shown here respectively for various intercellular recordings from the 
superficial depth of the visual cortex of mouse. Figure (A) shows the firing rate OSI 
distribution of excitatory (In the top row) and inhibitory cells (in the bottom row), 
data published by Niell et. al. [27] and figure (B) show the spikes recorded from in- 
hibitory neurons (total number of cells, n = 74) and excitatory neurons (total number 
of cells, n = 34) published by Runyan et. al.[32]. The orientation selectivity of PV+ 
inhibitory neurons shows a multimodal distribution. Because of a large group of un- 
tuned inhibitory neurons, the mean orientation selectivity index (OSI) of inhibitory 
population is lower than that of excitatory population (p < 0.5); however, a second 
mode centered around OSI = 0.8-1.0 in the inhibitory population distribution sug- 
gests a second subtype of inhibitory neurons with high selectivity. Figure (C) shows 
the spike, membrane potential OSI (top row) for all excitatory cells and 01 distribu- 
tions for conductances for excitatory cells (bottom row) published by Tan et. al. [41]. 
Figure (D) shows the spike, membrane potential OSI distributions (top row) and the 
inhibitory, excitatory conductance OSI distributions (bottom row) published by Liu 
et. al. [21] 
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Figure 2: Salt-pepper architecture of rodent VI. The cartoon sketches the architec- 
ture of network model classes implemented here in a computational framework: A layer 
of excitatory (blue triangles) and inhibitory neurons (green circles) receives afferent as 
well as lateral input. In the Hodgkin- Huxley networks, the number of inhibitory cells 
is one third of the number of excitatory cells. Cells are placed on a grid (inhibitory 
neurons in random grid positions) of 50x50 (Hodgkin-Huxley networks). Examples for 
lateral connections are indicated for an inhibitory neuron in an salt-and-pepper map 
(lines connecting to the neuron in the center) and an excitatory cell (lines connecting 
to the neuron at the right). The preferred orientation (PO) of each neuron is random 
as shown in the artificial orientation map. A circular Gaussian tuning curve with stan- 
dard deviation of 27.5'' is implemented. 2D Gaussian lateral connectivity based solely 
on anatomical distance between the neighboring neurons is shown on the right. 
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Figure 3: Operating regimes resulting from 19x14 different values of qee and gjE 
in the units of maximum conductance of afferent input to excitatory neuron g^^/^ ■ 
(a) Operating regime and regime boundaries of salt-pepper network model. Mean 
excitatory and inhibitory input currents are computed for points from each regime 
marked with red dot in figure 3 A and are plotted in figure (3 B,C,D, E). The mean 
excitatory and inhibitory input currents are depicted with blue and red solid lines, 
respectively, normalized with the afferent input at preferred orientation. The input 
currents at preferred orientation are aligned to °. The black solid lines depict the 
total aggregate input current. 
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Figure 4: Log of p- values are plotted for spike OSI, membrane potential OSI, excita- 
tory and inhibitory OSI distributions, p-values computed using two sample K-S test 
against experimental database. Computed p- Values are then plotted for 19x14 differ- 
ent values of recurrent excitation qee and gjE in the units of maximum conductance 
of afferent input to excitatory neuron g^^/^ ■ Null hypothesis of indistinguishable OSI 
distributions is validated by using a p-value threshold set at 0.05 at 95% confidence 
interval. Colours shifted more towards light blue/white in the colormap indicates sig- 
nificance (p > 0.05) and are enclosed by a boundary indiacted by black solid lines, 
hence, showing part of the parameter space that gives indistinguishable distributions 
(simulated OSI distributions vs experimental database). 
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Figure 5: Histograms for inhibitory and excitatory cells are shown for a recurrent 
point of our network. Vm OSI distribution is plotted in A, In B spike output / OSI is 
shown and in the bottom row, C and D shows ge, gi OSI distribution for the conduc- 
tances. Both inhibitory population spike OSI (shown in red) and excitatory population 
spike OSI (shown in green) are highly orientation selective for the default choice of our 
network parameters. 
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Figure 6: Connection between E-E connection pair in our network are drawn from 
triangular distribution. Probability of connection scales as a function of orientation 
difference between pre and postsynaptic cells in model VI. For example 0° orienta- 
tion difference has very high connection probability (about 0.4) and 90° orientation 
difference has low connection probability (about 0.2). 
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Figure 7: Log of p-values are plotted for spike OSI, membrane potential OSI, exci- 
tatory and inhibitory conductance OSI distributions with orientation dependent E-E 
connectivity. P-values are computed using a two sample K-S test against experimen- 
tal database. Computed p- Values are then plotted on a log scale for 19x14 different 
combinations of recurrent excitation g^E and recurrent inhibition g^E in tlie units of 
maximum conductance of afferent input to excitatory neuron g"^^^ ■ In A for Vm-, de, 9i 
region enclosed within the black solid lines indicate significance (p > 0.05). In B for 
/, deiOi parameter combinations enclosed by black solid lines show significance (p 
> 0.05). In D for inhibitory spike fmh OSI region enclosed by black solid lines show 
significant values (p > 0.05). 
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Figure 8: Histograms of all four response properties (/, Vm, Qe, di) are plotted using 
a recurrent point gjE = 2.5, qee = 1-5 of the model space with orientation dependent 
connectivity. Excitatory population shows high selectivity for subthreshold membrane 
potential and suprathreshold spike selectivity. Inhibitory OSI distributions are broad 
and less selective for membrane potential and spikes. 
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Figure 9: OSI distributions of afferent input received by excitatory cells and inhibitory 
cells in VI are plotted. A truncated Gaussian distribution is used with fixed mean (fi) 
and width((T) (see text for exact values used). Inhibitory afferent distribution has 70% 
of neurons those are untuned as shown (cells with OSI <^ 0.5). 



Response properties 


Datasets 


P-values 


P values based on K-S test 


Excitatory neurons V^, Qe and Qi selectivity 






Vm 


Tan vs Liu 


0.0235 


9e 


same 


0.6947 


9i 


same 


0.1548 


Excitatory neurons firing rate fexc selectivity 






fexc 


Tan vs Liu 


< 0.001 


fexc 


Tan vs Runyan 


0.0024 


fexc 


Tan vs Niell 


< 0.001 


fexc 


Liu vs Runyan 


0.7274 


fexc 


Liu vs Niell 


0.0307 


fexc 


Runyan vs Niell 


0.0068 


Inhibitory neurons firing rate fmh selectivity 






finh 


Runyan vs Niell 


0.0497 



Table 1: Summary of computed p values using K-S two sample test between reported 
orientation selectivity distributions of excitatory and inhibitory population distribu- 
tions for subthreshold response properties such as membrane potential, input conduc- 
tances (excitatory and inhibitory) and suprathreshold response such as spikes. 
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Figure 10: Mean and standard deviation of a truncated Gaussian is varied. Optimal 
values for fi, a is then decided based on K-S test to draw excitatory and inhibitory 
afferent input distributions. For figure (10 A, B) (Texc,(^inh is varied keeping mean ji 
of the truncated Gaussian distribution fixed. For figure (10 C, D), both aexc, o"mft and 
^J'exc, tJ-inh IS Varied by holding other two parameters. In A Log of p values are com- 
puted against OSI distributions reported by Liu et.al. for spike, membrane potential, 
excitatory and inhibitory conductance selectivity for all excitatory cells. In B Log of p 
values are plotted using data published by Tan et. al. for spike, membrane potential, 
excitatory and inhibitory conductance selectivity for all excitatory cells. In C log of 
p values are plotted using data published by Runyan et. al. for spike selectivity of 
excitatory and inhibitory cells. In D Log of p values are plotted using data published 
by Niell et. al. for spike selectivity for excitatory and inhibitory cells. Blue/white 
colours in our chosen colormap indicates ggnificance (p > 0.05) 
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Figure 11: Log of p- values are plotted for spike OSI, membrane potential OSI, exci- 
tatory and inhibitory conductance OSI distributions with afferent specificity. P-values 
are computed using a two sample K-S test against experimental database. Computed 
p- Values are then plotted on a log scale for 19x14 different values of recurrent excita- 
tion gEE and recurrent inhibition qje in the units of maximum conductance of afferent 
input to excitatory neuron QeI f ■ In A for Vm region enclosed within the black solid 
lines indicate significance (p > 0.05). For, /, g^-, Qi all parameter combinations below 
the black solid line is significant (p > 0.05). In B for Vm, Qe parameter combinations 
above the black solid line shows significance (p > 0.05). For /, gi significant parame- 
ter combinations are again enclosed by black solid lines. In C for excitatory / region 
under black solid lines shows significant values (p > 0.05) and for inhibitory / most 
significant part of the parameter space is enclosed by boundaries. In D for inhibitory 
/ only few points above the marked boundary satisfies p > 0.05 
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Figure 12: Population histogram data for fOSI, VmOSI ,geOSI , giOSI of excitatory 
and inhibitory cells for a recurrent point (within significance boundary) are shown in 
A, B, C, D respectively. Distribution use default number of Nee = 100, N[e = 
50 connections in a recurrent network with afferent specificity. A multimodality is 
observed in the inhibitory distribution of OSI (in red) in B 
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Figure 13: Log of p-values are plotted for spike OSI, membrane potential OSI, ex- 
citatory and inhibitory conductance OSI distributions with afferent specificity and 
fine scale recurrent connectivity. P-values are computed using a two sample K-S test 
against experimental database. Computed log of p- Values are then plotted for 19x14 
different values of recurrent excitation (jee and qje in the units of maximum con- 
ductance of afferent input to excitatory neuron q'e/^ ■ In ^ parameter combinations 
above the black solid boundary provides significance (p > 0.05) against Liu Vm OSI 
distributions. For Liu /, di all network parameter combinations below the black 
solid line shows significance (p > 0.05)(shown in blue/white colours). In B for Tan 
Vm, 5e data grid points above the black solid line provides significance. For /, gi 
points within the enclosed black solid lines provides significance (p > 0.05). In C all 
the points below the black solid line shows significance (p > 0.05) against excitatory 
spike selectivity data from Runyan et. al. and all the points within the enclosed black 
solid lines provides significance (p > 0.05) against inhibitory spike selectivity. In D 
all the points within the black solid lines liSlicate significance (p > 0.05) against Niell 
inhibitory spike selectivity 
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Figure 14: Population histograms for / OSI, VmOSl,ge OSI, gi OSI of excitatory and 
inhibitory population for a recurrent point of our model space with afferent specificity 
and feature specific connectivity are plotted in A, B, C, D. Distribution use default 
number of Nee, Nje connections. In green, excitatory population distribution and in 
red, inhibitory population distribution are shown 
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Parameter Description Value 
Network 

D Network dimension 50 

A^^ Afferent to eacfi neuron 20 

Cell Properties 

Cm Membrane capacity 0.35nF 

Leak conductance of excitatory cells 15.7nS 

Leak conductance of inhibitory cells 31.4nS 

El Leak reversal potential -80mV 

Background activity 

gig Mean excitatory background conductance Q.bQ-gL 

gig Mean inhibitory background conductance l.SA-gi 

T^g Excitatory time constant 2.7ms 

rig Inhibitory time constant 10.5ms 

a^g Standard deviation of excitatory conductance O-Ol-g^ 

alg Standard deviation of inhibitory conductance 0.01-gL 

Elg Reversal potential of excitatory conductance -5mV 

Elg Reversal potential of inhibitory conductance -70m V 

Connectivity 

Nee — NjE Excitatory synaptic connections per cell 100 

Nei = Nil Inhibitory synaptic connections per cell 50 

c"_B = o-j Spread of recurrent connections (std. dev.) 4 pixels (50 iim) 

Synaptic properties 

Ee Reversal potential excitatory synapses OmV 

Ei Reversal potential inhibitory synapses -SOmV 

Te Time constant of AMPA-likc synapses 5ms 

Tj Time constant of GABA^-like synapses 5ms 

Ti Time constant of NMDA-like synapses 80ms 

T2 Time constant of NMDA-hke synapses 2ms 

^dday Mean excitatory synaptic delay 4ms 

cr^^'"^ Standard deviation of excitatory synaptic delay 2ms 

^deiay Mean inhibitory synaptic delay 1.25ms 

^deiay Standard deviation of inhibitory synaptic delays 1ms 

Afferent synaptic strengths 

g^^^ Afferent peak conductance to excitatory cells 9-5 ■ gf 

gf^^ Afferent peak conductance to inhibitory cells Q.l?>-g^^^ 

Recurrent synaptic strengths 

gii Peak conductance from inh. to inh. cells l.'i'i-g^^^ 

gEi Peak conductance from inh. to exc. cells 1.33-^^"^'^ 



Table 2: Parameters of Hodgkin-Huxley network model 
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Gating var. 


ci [mV-1] 


C2{V) [mV] 


csiV) [mV] 


c4 


«7Va act 1 


0.32 


-(1^ + 45) 


-(l^ + 45)/4 


-1 


(^Na inac 1 


0.128 


1 


(V + 51)/18 





<^Kd act 1 


0.032 


-(y + 40) 


-(y + 40)/5 


-1 


QiM act 1 


-0.0001 


y + 30 


(\^-30)/9 


-1 


QiATa act 2 


-0.28 


-{V + 18) 


(l^ + 18)/9 


-1 


«7Va maci 2 


4. 


1 


-{V + 28)/5 


1 


CtKd act 2 


0.5 


1 


+ 45)/40 





Q^M oct 2 


0.0001 


y + 30 


(y + 30)/9 


-1 



Table 3: Expressions for channel dynamics 
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